-
Notifications
You must be signed in to change notification settings - Fork 28.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL #23342
Conversation
-Added documentation for loading csv files into Dataframes
- Some examples on how to create a dataframe with a csv file (cherry picked from commit e8ca1dc)
-Added documentation for loading csv files into Dataframes
- Some examples on how to create a dataframe with a csv file (cherry picked from commit a546421)
# Conflicts: # docs/sql-programming-guide.md # examples/src/main/java/org/apache/spark/examples/sql/JavaSQLDataSourceExample.java # examples/src/main/r/RSparkSQLExample.R
- Some examples on how to create a dataframe with a csv file
- PR comments
- PR comments
- PR comments
* Added full docs for reading csv files
* Added full docs for reading csv files
- remove old json line from chapter
- update links
# Conflicts: # docs/sql-programming-guide.md
* added documentation for SSL with Mesos
docs/running-on-mesos.md
Outdated
@@ -108,6 +108,19 @@ Please note that if you specify multiple ways to obtain the credentials then the | |||
|
|||
An equivalent order applies for the secret. Essentially we prefer the configuration to be specified directly rather than indirectly by files, and we prefer that configuration settings are used over environment variables. | |||
|
|||
### Deploy to a Mesos running on Secure Sockets | |||
|
|||
If you want to deploy a Spark Application into a Mesos cluster that is running in a secure mode there are some environment's variables that need to be set. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
environment variables
docs/running-on-mesos.md
Outdated
|
||
all options can be found at http://mesos.apache.org/documentation/latest/ssl/ | ||
|
||
Then submit as usual or as described below |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
perhaps say as described in Client mode or Cluster mode below
docs/running-on-mesos.md
Outdated
- `LIBPROCESS_SSL_KEY_FILE=pathToKeyFile.key` path to key | ||
- `LIBPROCESS_SSL_CERT_FILE=pathToCRTFile.crt` the certificate file to be used | ||
|
||
all options can be found at http://mesos.apache.org/documentation/latest/ssl/ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
all -> All
* PR comments
@srowen @felixcheung pr updated |
It is merged to master. I missed running the tests so those are running now, but it's a doc change and shouldn't be a problem |
I saw it. I was just confused about the git symbol. Thx |
Test build #4482 has finished for PR 23342 at commit
|
That error can be ignored; this didn't cause functional changes in Python |
## What changes were proposed in this pull request? Added docs for running spark jobs with Mesos on SSL Closes apache#23342 from jomach/master. Lead-authored-by: Jorge Machado <jorge.w.machado@hotmail.com> Co-authored-by: Jorge Machado <dxc.machado@extaccount.com> Co-authored-by: Jorge Machado <jorge.machado.ext@kiwigrid.com> Co-authored-by: Jorge Machado <JorgeWilson.Machado@ext.gfk.com> Signed-off-by: Sean Owen <sean.owen@databricks.com>
## What changes were proposed in this pull request? Added docs for running spark jobs with Mesos on SSL Closes apache#23342 from jomach/master. Lead-authored-by: Jorge Machado <jorge.w.machado@hotmail.com> Co-authored-by: Jorge Machado <dxc.machado@extaccount.com> Co-authored-by: Jorge Machado <jorge.machado.ext@kiwigrid.com> Co-authored-by: Jorge Machado <JorgeWilson.Machado@ext.gfk.com> Signed-off-by: Sean Owen <sean.owen@databricks.com>
What changes were proposed in this pull request?
Added docs for running spark jobs with Mesos on SSL